IBM Research and the Department of Brain and Cognitive Sciences at the Massachusetts Institute of Technology have joined forces to further develop the scientific field of machine vision – a core aspect of artificial intelligence. Big Blue and MIT will build the IBM-MIT Laboratory for Brain-inspired Multimedia Machine Comprehension, or BM3C, in Cambridge, Mass. Together they plan to develop cognitive computing systems that mimic the human ability to understand and integrate input from multiple sources for use in a variety of computer applications in industries such as healthcare, education, and entertainment. MIT researchers will collaborate with IBM scientists and engineers who will provide technology expertise and advances from the IBM Watson platform. The BM3C will address technical challenges around both pattern recognition and prediction methods in the field of machine vision that are currently impossible for machines alone to accomplish.

IBM Research and the Department of Brain and Cognitive Sciences at the Massachusetts Institute of Technology have joined forces to further develop the scientific field of machine vision – a core aspect of artificial intelligence. Big Blue and MIT will build the IBM-MIT Laboratory for Brain-inspired Multimedia Machine Comprehension, or BM3C, in Cambridge, Mass. Together they plan to develop cognitive computing systems that mimic the human ability to understand and integrate input from multiple sources for use in a variety of computer applications in industries such as healthcare, education, and entertainment. MIT researchers will collaborate with IBM scientists and engineers who will provide technology expertise and advances from the IBM Watson platform. The BM3C will address technical challenges around both pattern recognition and prediction methods in the field of machine vision that are currently impossible for machines alone to accomplish.

One of the biggest challenges will be to advance pattern recognition and prediction. A human can easily describe what they saw happen in an event and predict what happens next, IBM says, but that's virtually "impossible" for current AI. That ability to quickly summarize and foresee events could be useful for everything from health care workers taking care of the elderly to repairing complicated machines, among other examples. There's no guarantee that IBM and MIT will crack a problem that has daunted Google, Facebook and countless academics. However, it's rare that scientists get access to this kind of technology.

Autonomous robots and other AI systems still don't do a great job of understanding the world around them, but IBM and MIT think they can do better. They've begun a "multi-year" partnership that aims to improve AI's ability to interpret sight and sound as well as humans. IBM will supply the expertise and technology from its Watson cognitive computing platform, while MIT will conduct research. It's still very early, but the two already have a sense of what they can accomplish. One of the biggest challenges will be to advance pattern recognition and prediction.